Sf-/8 

MW 



Telerobotics: Research Needs for Evolving Space Stations 



L. Stark 

- . > 


University of California, Berkeley 
Berkeley, CA 94720 

> c • / 

1. Introduction 



The definition of 
language dictionary. 

telerobotles (TR) has not yet stabilized 
I tend to uae telerobotles as aeanlng 

nor aade the etandard English 
reaote control of robots by • 


huaan operator using supervisory and soae direct control. Thus, this Is an lsoortsnt area 
for the HASA evolving soace etatlon. By robot. I inn a iiiloalitor/iobUltf devtce » t th 
visual or other senses. I do not nase aan t pula t o rs . as In sen* lnduetrlil autoeatlon set- 
ups, robots even If they sen be flexibly progressed: rether e.lllng theee prograsable 

aen l oul e to r e. Our own laboratory it the University of California, Berkeley, has been 
Involved In orobleas In dlsolay of Inforuatlon to the huaan ooerator. In orobleas of control 
of reaote aanloulators by the huaan operator, and In c o a a un l ca 1 1 on delays and band-width 
llaltatlons as Influencing both control and the display. A nuaber of recent reviews have 
aooeared with discussions of the history of telerobotics beginning with nuclear olants and 
underseas oil rigs. 


2. Three 5 laul taneous Research 0 1 rec 1 1 ons 

t believe that we should e n g e g e In trlollcate or three way planning. tt Is laoortan'. to 
carry out our researeh to accoapllsh tasks (1), with aan alone. If possible, such as In SVA 
(ex tra -vehicular activities), (ll) with autonoaous robots (AS), and (ill) with telerobotles. 
By eoaoarlng and contrasting the research necessary to carry out these three approaches, we 
aay clarify our oresent orobleas. 


There are problems using aan alone. The 
soace envlronaent Is hazardous, tt Is very 
exoensive to have a aan In space: NASA a u s t 
have quits adequate cost figures obtained 
froa the de sons tra t l on prolects that have 
already been accoaollshed with the shuttle 
orograa. We aay also need a higher quality 
of osrforysoce than aan alone can orovlde In 
teras of strength, resistance to fatigue, 
vigilance, and In aeeting special orobleas. 
For exaaole. If the soace suit Is not of 
constant voluae under flexible changes of the 
llsbs. then a great deal of strength Is used 
uo lust In aaintaining posture. 


FIGURE 1: UUfUCATE ElAIffllSfi 

PROBLEMS «!TM g&H ALONE 

HAZARDOUS ENVIRONMENT: 

l SPACE SIMILAR TO NUCLEAR PLANTS* UNDERSEAS) 

EXPENSIVE U.E. EVA IN SPACE) 

NEED INCREASED QUALITY IN 

strength 

FATIGUE RESISTANCE 

VIGILANCE 

PERFORMANCE 


Problsss with mtorioio'is robots 1 i * In 
our not hiving sister®-! tbs technology to 
bull! thes hiv® thes osrforo sitlsfmto- 

r i ly. They ire not y* t iv*lliblsl t n \ i s i , 
designs ir* not rot fixed i n d it is not 
oertiln bow feislble they will be. esDeciillr 
lb tens of robustness ind reliibility. 

Therefore, we oin see tbit te leroboti z s 
i s i /l nb l* l e 1 d l n g * U? t • o h m l s g v . 
However- ill three directions snoali be 
Intensively o u r s u e d In reseiroh ml 
ievNloosent* esoeolilly for tbe nett stipes 
of tbe evolving some stitlon olmning. 


PROBLEMS HITH AU y 2NQI1CUJ ROBOTS 
NOT vET AVAILABLE 
DESIGN «0T 

FEASIBILITY vOT CEVaJ.V 

RELIABILITY hot tested 

THEREFORE: IS IS A VIABLE LEADING EDGE ’ECHNCLOGV 

*(.- *.-R££ DIRECT :;*S SHOULD 3E 5L?®CR’ED : CR Ey-OLVING . ; AC£ 

STATION PLANNING. RESEARCH. AND DEYEL3PMENT . 


5. Some 3titlon risks 


One of tbe 11 jor roles tbit o m 

stitlon. In this wit reseiroh regirding 
5in be guided. For 1 list of seven grouos 


olir is to bvootbeslte tis*cs 
the design of telerooots to 
of tisKs see Figure 2. 


for tbe evolving some 
moosollsh these tisks 
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4 s I Kill somUir litir, It 13 
laportsnt to distinguish bstwssn thoss 
tisks unl-jus to ths N434 /s vo l v InR Sosos 
Ststlon snd thoss with "Industrlsl 
drlvsrs" thst will sooomollsh 
dsvslopmsnt of nsw tsohnoloRlss In 
hopsfully s superior fsshlon snd thus 
snsbls conssrvstlon of llmltsd N4S4 
rssouross. 


4 . Probl s ms In Ts 1 srobo 1 1 o s 

This nsxt ssotlon of my tslk. 
rsvlsws of oroblsms In tslsrobotloj, 
■111 bs sbbrsvlstsd. Ths rsvlsw Is 
dlvldsd Into oroblsms In tslsrobotlos 
aonosrntnR dlsolsys. vision snd othsr 
ssnsss (Flours 1) snd oroblsms In 
tslsrobotlos dssllnR with oontrol snd 
aomaunlos tlon (Flours l). 

In ssoh ssotlon. I stsrt with bsslo 
propsrtlss of ths humsn oosrstor snd snd 
up with Dlsnnsd ososbllltlss of 
autonomous robots. In bstwssn, I try to 
eoysr *hst knowlsdRs sxtsts now In our 
flsld of tslsrobotlos. (in slso 
aomosnlon pspsr by 3tsrk st st In this 
votums . ) 


FIGURE 2: 

NASA SHOULD HYPOTHESIZE TASKS FOR EVOLVING SPACE STATION 


HDUSEKFEPING 

UFE Sl/PPORI SYSTEMS 

Inventory control, access and storage 
Record KEEPING 
Garbage disposal 


P rotection 

From space garbage 
From meteorites 
From traffic flow 


Maintenance 

Satellite 

vehicles 

Space station itself 


CfltiSTRUCTlON 

additional space station structures 


Manufacturing 

Crystal growth, biopharmaceuticals 


mobility 

Automatic piloting 

NAVIGATION 

Path planning 


SCIENTIF IC 

LANDSAT type IMAGE PROCESSING FOR AGRICULTURE 

Meteorology 

Astronomy 

Human factors research 
Scientific record keeping 


figure 5: Display Problems fjjr tm£ HUMAN operat es 
Human vision LLV. miv. hlv 
Display Graphics i raster/vector i 

On-ihe-screen enhancements 
On-the-scene enhancements 
other senses displayed: 

Inputs to oiH r R senses 


FIGURE r: Control anj Communication Problems for the Human Operator 

Basic Properties of h.o., especially for Eva task performance 
nerve, muscle, ag/at model* 

Sampled-data isdi and adaptive control 
prediction, preview, optimal control—kalmah filter 

H.O. Control of vehicles, manual control 


perspective and Stereo Displays 

'tsk performance criteria 


HELMET 

ICC: SPACE CONSTANCY 

human Operator ih.O.) Performance 

fatigue, effort, vigilance 


h.o. Control of TR 
h.o. Special Control: 

preview, delay, bilateral, homeomorphic control 
Locomotion i human, robotic i ; 

NAV I GAT I ON- -PATHWAYS 

Potential field algorithms 


robotic vision* 

LLV - Chips 

MLV - BLOCKWORID AND HIDDEN LINES 
HLV - I CM. Al 


Sots: LLV Is lowsr Isvsl vision, 'ILV, 
mlddls Isvsl vision. HLV hlRhsr Isvsl 
vision. Including ICH, Ihsrs oomorss- 
slon by modslln? snd 41. xrtlflolsl 
In ts l l l Rsnos . 


HLC (HIGH LEVEL CONTROL!; 

Supervisory control 

multiperson cooperative control; RCCL: fuzzy sets 

autonomous Robotic car> control 

Sensory feedback, adaptive control, ai 

*Nots: 4G/4T Is so s Ron l s t /sn ts Ron l s t musols 

oslr. rsolorooslly Innsrvstsd for fsst movsmsnts 
snd oo -oon trsa tsd for oosturs snd Imosd-nos 
oontrol . 
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5. Industrial Orlwnrs For Csrtstn !>sessssrr SoYCn StYtlon Tnchnolo^ln y. 

This n«*t ssetlon dssls with ths futurn. snd ssosolsllr with "tndustrlsl drlrsrs" otbnr 
thsn 1)51 for nsw tnohnolORln y which wst bs rsqutrsd In ths swotwln? Sosos Ststlon. In Floors 
5 I list nlns cosoonsnts of s tslsrobotlos srstss thst osrtslnly ssss to bs drlwnn hr 
laportsnt tndustrlsl hsrdwsrs rsqulrsssnts. rssssroh snd dswsloossnt. Thsrsfors. It sssss 
rsssonsbls for 1151 to sit bsst snd wslt for snd srslosts thsss dsvs 1 oossnts. ssrln? Its 
rssourcss for thoss nsossssry tsshnolo^lss thst will not bs so drlwnn. 


FIGURE 5: Drivers Ottkb Than MSI for Ring nffpfd TEowwotcfiiES 
Robotic Manipulator uts Control Sow is 

JOYSTICK - MKMTT 

48 MANUFACTURING InSUSTNY. NUCLEAR INDUSTRY. MINING 

Industry. Sensors: force and touch: compliant control 

Bay MB RBBIUTT 

Military, tanks and other vehicle flans? 
undersea ROV - Oil and CommiCATioNS Industry 
locomotion - university Research 
Shipping Industry: Ships at Sea iar. TR. man) 

U Camera 

EnTERTAIRMENT tNDUSTRY - COMMERCIAL DEVICE 
Security Industry 

need mounts. CONTROLS and motors for pan. tilt 
AND FOR STEREO VS 

Graphics 

Entertainment industry is a better driver than 
companies building Flight Simulators: 

m AS AN EXAMPLE. 

EM SENSORS RESEARCH/ HEAD-EtE MOUSE 

1£B 

Landsat 

Security 

medical Industry - CT and KRI 
Industrial produC'idn lines 
T3 - Image UNDERSTANDING 

CQM?U TE 5 

Computer Industry 
ihDW) and I SFM> 

Computer Science research base is now very eroad 

COWPJN I CATION 

Communication Industry is huge 
Ships at Sea 
Bn Compression 
Remote du Rigs 
arctic Sta-IONS 

Pi ans and Rrmtocoi s sj comba- h.q, fatigue and 
in rRcmotc vis: ancp 

Off'CE Automation FORCES 

A;r ’aaff.'C Son": _ NEEDS 

Security industry 

Cqcperavve Control 

militar* - submarine control 
helicop'ER flight control 
air traffic controllers 
nuclear industry 
Chemical plant industry 


Looking it th«ss fl^urnn ^Iyr* m lit* 
noninot of how Induntrlnl dnwnloD'RMnt itT 
orovldn vytIouy tyofs of tnohnolo^lno for 
thn ryoIyIor Soy on Stntloo: Indnnd. 5151 vr 
bn Ybln to olok ml ohoosn frow off-thn- 
Yhnlf Itnn! For nwYtoln. thn tost oownrful 
oowoutnrs on thn loot nonm YhuttlnY wnrn 
thn hnnd-hnld oortYbln, oomutnro thit thn 
utroni'its brou^h* nbonrd whloh contYlnnd 
•auoh Rrnntnr oiov llty thnn thn on-bonrd 
nonoutnrY: thown hnd bnnn ’ ' ) z n In thntr 

dnnl^n tnn tytts y^c In thn olYnnlnR y tY yn y 
for thn YOYOY nhuttln. 

6. 1»o»siirT Tnlnrnbottm Tnohnnl oy lnn to 
bn S oy rknd bv S 1 S L 

Hownvnr. t h n r n ir? y n v n r y 1 y r n y y tn 
t » 1 n robo 1 1 o n thYt iyt llknly not bn drirnn 
Indnonnlnntly of 1151. or w h n r n HS1 yyt 
hYvn on lYDortYit roln to dIyt. tndnnd. thn 
ConRrnYY hYY Yonolf I iyI ly YYndYtnd thYt lit 
of thn Soyoy StYtlon bud^nt nhoul d bn unn i 
for 1’itoYYtioo yoI Robotics dnvnloomnt. Ynd 
thYt thin In you YnnYn Yhould YOnYrhnYd 
InduYtrlYl robotics In thn 'Jnttnd StYtnn 
(Ftyum 6 ). 

FIGURE 6: Areas Sparked by NASA not inciis*riai i y Driven 

visual Enhancements eor Graphic Display 

Telepresence mith Stereo helmet mounted Display ihmdi 

Mjltisensory Input Ports: 

HORRY about H.D. OVERLOAD CONDITION 

(especially mith cooperate e control and comjNtCATiON* 

higher level Robotic vision: 

Example— Image Compression by modeling iICMi 

(to require less information flom and paster update) 

Special Control modes for h.o. 

HOMEOMORPHIC CONTROL 
Bilateral control 

Time delay and preview control for t :>w delay 
Compliant control 

higher level Control languages 

(SUCH AS RCCL; cuzrv CONTROL: path planning BV POTENTIAL 
FIELD CONSTRUCTION! 

= E«C*E OPERATING 'VEHICLES 1 ROV > SPECIAL CONTROL PROBLEMS: 
NAVIGATION. ORIENTATION. OBSTACLE AVOIDANCE FOR SJV 

COOPERATIVE CONTROL: 

COOPERATION AMONGST HUMANS. "ELERCBOTS. and AUTONOMOUS ROBOTS 

Compliant. Flexible, homeomcrpmic "anipula—rs 
Grasp 'versus tool using 

hcpydmcrphic Dual moc Control 

Impedance Control 
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7. Pntrnrstty USt Rnsnsrch 

t now mull Ilk* to «nkn * plnn that UH nhoull nxosnl ill itliuliti tilirobitln 
research conluotnl within thn unltirjltr niflromint. Of «»ur«, 11 * orifniir t ht have * 
hi** In this llrnotlon ini T 11 wllllny to listen to contrary lr^tmti! tn yllltlon to to* 
benefits of thn ruiirjh nccowollshnl by unliiriltlii, ItlSt 1 I 10 yets thn iluii tloi ill 
trilnln; of now nnylnnnrlny iinoswir specifically llrutil tawirli tnlnrsbotlcs. ini foiaul 
on thn irolrln; Som Station. 

Phot klnl of university ml ilii;itlonil rimr;h shoull bn fanlil In tiiirit by Plot. X 
ball*** there nrn two litili of c"d s t t w l th however thro* llrnctlonsl Into whloh than* 
iluntloul ruiirih libi jhi'jll bn olooolflol. 

(1) flrnt nrn Slwulat ton Tnl nrobo ttcn Labor atorie s. Horn wn nnnl yrnohlcn eomutin, 
onrhnos loystloks. onrhnos hl?hir "fiiril suonrvTsory oontrol lnnyunyns. cnwnrns. lank* cow- 
ornnnlon tnchnliuns nnl cowwunlcn tlon schnwns. t woull yunnn that our country nnnls nt leant 
thirty such nyntnnn for nlucntlon ini trnlnlny. Thnnn orntooo nhoull bn wnry lutonnilti. 
no or o * 1 wn tn ly 150.000 nnoh. Thny nnnl not nrnn bn onll for by USl. nlnon universities inn 
orovlln such research nlwulntlon Inborntorinn out of tholr niuonttonnl bulynts or fron nnnll 
Inllvllunl research yrnntn. Our Tnlnrobotlon Unit nt Berkeley hnn bnnn thun funlnl. K yool 
lnnl of nnolorntory rnnnnroh onn bn onrrlel out Innxonnnl vnly In thin wnnnnr. 

(ill Seconl. wn nnnl Tnlerobotlo Inborntorinn with ohy n Ion 1 wn n l pul n to r n ornnnnt nn 
Iwoortnnt rnnnnroh oowoonnntn. Tn thin wny. nxonrlwnntn w l th”vnrrous* robotic "wnntoulntors. 
nnonolnlly thonn with noaoloT oontrol ohnrnotnr Intlon suoh nn flnxlblllty, hownoworohlo Torn, 
new leveloownntn In yrnnoers. nnl xnrlnbln Iwoninnon oontrol wolnn. othnr than nrn founi In 
ntnninri Inluntrlnl wnn loul n tor n. woull bn oosnlbln. X yunns that thnrn nrn about five nuoh 
Inborntorinn In now* ntnyn of leveloowent nt wnlor universities In thn country. X woull 
further nntlwntn that thnnn Inborntorinn ooull nnoh unn nn Initial leveloowent bulynt of 
$500,001 to nnnbln thnw to ourohnnn nnonnnnry hnrlwnrn In nllltlon to noftwnrn nn nxlntnnt In 
thn Slwulntel Tnlnrobotlon Unborn torlnn. 

Inooher 3nt of oontly Inborntorinn woull bn Tnlnrobotlon Lnborntorlnn with rnwotn 
oonrn torlny vehicles (3071 . Here nynln. wn nnnl about five Inborntorinn nt unlrnrnltlnn with 
f T r n't olnnn eoyineerlny nohooln. lynln, X nntlwntn about $500,000 nnoh for thn Initial 
hnrlwnrn nuooort of thnnn 507 labn. Thny ooull thni ntuly trnnnfnr vnhlolnn. loonl Sonon 
Station vehicles, 5ooi/$nrn Soinri, nnl oxen oowonrn 77U vs. tnlnrobotlo oontrollnl vnhlolnn. 

Thn unlvnrnlty Inborntorinn woull contrast with nnl nnrvn n llffnrnnt f unction than 
onyolny nnrononon Inluntrlnl Inborntorinn. nnl 7131 nnl othnr yovernwnnt Inborntorinn. Thnnn 
Inttnr nnnnwbln hnrlwnrn for Inwonntrntton nnl fnnnlbtllty stullnn. Thnn unfortunn tn ly thov 
nrn nownhow unnbln to carry out onrnful huwnn factors rnnnnroh lenllny with thn ohmyioy 
leslyn of nuoh olnonn of evilownot. tn thn unlvnrnlty nettlny, thin noonrntun ooull bn tn'xnn 
nonrt. c hnn ye 1 . rnvltnllxnl. woltflnl nnl thn flnxlblllty woull Inforn our current 
capability. X woull like to contrast thn Sonnnwnr Senior nnl Uosnnwnr llbntronn with thn 
7131 oroyrnw. tt wnn olnnr that If BcXrenlv wnn nvnr to bn suoonooful, hn hnl to buill nn 
nxonrlwmtnl olnnn which wnn nxonotnl to break lown nnoh nxonrlwmtnl lav. But thn olnnn 
ooull bn rnonirnl io n few wtnutnn! Thin "laboratory bench" oononot In no llffnrnnt fron 
t w en t 7 -yen r -a he a 1 -ol nnnl ny currently oootrolllny our nonce oroyrnw that hnn bnnn nffnotlvnlv 
nllwtnntnl nt 7131. I think It In Iwoortnnt to rnlntroluon rouyh-nnl— rnnly flnll 
Inborntorinn back into thn nonce oroyrnw. 


3. 7 \ 3\ ?rt ten 

Another role that 7131 wlyht olny In to offer In wonn tr n tl on contracts or. nvm better, 
arises for nccowol t nhwnnt of nonclflc tanks. lynln X turn to thn Krnwnr frlte; hnrn n 
orivntn iollvilunl lonntnl orixn wonny to on nwnrlnl to thn flrnt to buill n wnn-oownrnl 
aircraft conforwicy to certain carefully Inti out non c 1 f l on t l onn. 

Z o n nun i c a t i on channels for oootrolllny rnwotn vehicles nnl rnwotn wnnioulntors nrn 
nlrnnly net uo. Thun wn coull have orltn contestants lnwonntrn tiny nt llffnrlny locations on 
earth nt one "y": next 1 e a oo n trn t i one usloy nlnwmtn cnonbln of oonrnttny In nonce, or even 
worn ntrinymtly. of havlny that wlnlwuw wans cnonbln of bnlny llftnl Into nonce; nnl then «n 
wlyht have true shuttle nnl nonce station In w onn trn tl onn. 

3. To tn 1 1 nc tun l oroble we l n T3 for thn Space Station 

finally. I woull like to leave you with thn thouyht that thn lint of to-be -son rkel -bv- 
7131 oroblnwn in fiyurn 5 contains wnny iwoortnnt Intellectual oroblnwn fnciny thn nrnn of 
t n l n r obo t i c s. \lthouyh thnnn areas nrn bnlny nooronchnl In our research cowwunlty nt thn 
ornnnnt tine, it wny not bn oosnlbln to fornnn what novel klnls of chnllnoynn will face thn 
nvolvloy Sonon Station In twenty yearn. Svno thouyh X war not ore! let accurately, X certainly 
boon X aw them in onrnon to watch tnlnrobotlon olnviny a wnlor role to oonrntlny thn 'once 
Station. Ickw owl nlynwnnt : Siooort fron J?L (bSSS'M). Or. Beltsy; 7131-lwen f 7 X X - 3 o "I . Sr. 
Sills; nnl liscunnlon with collnoxunn Ore. W. 3. Klw. r . Tnollck nnl 3. Hnnnnforl. 
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